This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



ion 



(19) 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(43) Date of publication: 

06.09.2000 Bulletin 2000/36 



(ii) EP 1 03S 662 A2 

EUROPEAN PATENT APPLICATION 

(51) IntCI.': G06F 17/30 



(21) Application number 00301287.9 

(22) Date of filing: 18.02.2000 



(84) Designated Contracting States: 

AT BE CH CY DE DK ES Fl FR GB GR IE IT U LU 
MC NLPT SE 

Designated Extension States: 
ALLTLVMKROSI 

(30) Priority: 01.03.1999 GB 9904662 

(71) Applicant: CANON KABUSHIKI KAISHA 
Tokyo (JP) 



(72) Inventor: Elworth, David, 

Canon Research Centre Europe Ltd 
Guilford, Surrey GU2 5YJ (GB) 

(74) Representative: 

Beresford, Keith Denis Lewis et al 
BERESFORD & Co. 
High Holbom 
2-5 Warwick Court 
London WC1R5DJ (GB) 



CN 

< 

CM 
CO 
CO 

CO 
CO 



(54) Natural language search method and apparatus 

(57) A method and apparatus for performing a 
search for information containing natural language is 
disclosed which uses a natural language query. The 
query is input in the form of units of the natural language 
and this is matched with units in the natural language of 
the data. Where there are unmatched units in the query 
and/or the data, context data in the form of one or more 
unmatched units of the query and/or the data is gener- 
ated. Each unmatched unit as a predefined linguistic re- 
lationship to one of the or each matched unit Output 
data is formed as matched units with any respective 
context data. 
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J001] The present invention generally relates to a method and apparatus for. performing a search for information 
^'n^tural language^ 

T^ 9 informa «° n for matches to the natural language query Chamethod 
S T Mos ,nformat, °" retrieval «J»ten» « q««e good at finding information but poor in presenting the results to 
users. Typ.ca.ly the results are presented as a simple fist of dBBu^^dooM^Z^^X^Jl^ 

l^T i ^ ( r rCh e " 9ineS '° impr ° Ve °" ^ b * for grouping pages™ n Te samt 

srte together. It ,s difficult for users to make effective use of results lists, because the results list does rJshow^ 
documents are related to one another and to the original query. 

i°r!I ) lc, lnf0flna,iOn S , y i! ,emS 030 reWeVe information ^ing linguistic queries in several ways The simplest 

totT a T ' S T 8 U , Se ° f I"' W ° rdS - WOfdS ^ * C ° mbined ^ B °°> aa " 'o9ic or sta JficaU^luTs 
to form a query. It is also known from an article by S Flank entitled "A Layered Aooroachlo Ml P-ftJ~! « 
ReWevaHProceedings of the 36 Annua. Meeting* the Assodafion o^ 

that a nafcra. language input can be translated to a search engine specific Boolean logic queTsu^aJe^n S 
however d^^^^ 

[0004] The^retnevat of information using syntactic information from natural language queries has been achieved in 

rrarwnorartsystems.Asystemdes^^ 

forr^umentRemevakAComparisonofSyn^ 

nical Report TR 87-868) uses augmented phrase structure rules to selectively e^^seslm 

erated by an automatic syntactic analyser. 9 

E tUT^ lan9U ! 9e P w 0C f f* 19 baS6d informatio " ret " eva ' also described in the paper by Flank referenced 
above. The technique descnbed in this paper uses noun phrase syntax analysis rererenced 

10006] Another method of retrieving information is disclosed in an article by C Schwartz entitled "Automatic <wmu 
Analysis of Free Text" (General American Society For Information Science, SeptembJ So naaesTo 
the technique disdosed by Schwartz, noun phmses are 

mtte information and theyare selected for parsing. The parsed noun phrases are noLlised sTtte 

Z! Z T- IT*** fitted ,0 Standard W COmm ° n *P"*«* ««~ctures. Noun phrase maSng Z Tkes 

Sa y ^ 

a more accurate searching techmque, it does nothing to overcome the problem of how to present the results ofthe 
d^men^n^ 

documents are related to one another or to the original query 

oX 8 La!ir^ 

[0009] '"accortancewimanaspertofthepres^^ 

n the form of units of a natural language. An input query is matched to a plurality of available sets of Mh™ Z£Z 

contort data comprises one or more unmatched units of the query and/or the sets of information each of which has a 
predefined syntactic relationship to one of the matched units. The data output thus comprises the matched unite: I* 

abiTr l e r d 0 ft a '7 uisac relationship to *° ma,ched ™ s -^«SS3S2iS 

ables the user of the search engine to not merely identify what is matched but also the context in which it matched 

[001 0] In ffie context of the present invention natural language data comprises a series of units of a natural lanouaae 
which have linguistic relationships therebetween. language 

E!2L I^iT'lr ,e ^ niqUe 03,1 ""^ 3 Simp ' e ^^'"^ng^niqua-Thishasfte benefit of simplidty 
but does not benefit from the syntactic information available to improve the matching process. If keyword searcnina te 

I0 °, 121 J"^ '° make USe * "* syntactic info ""ation available in the input query and in the sets of information 
preferably.meque^andmesetsofinfo^ationareparsedandm^ 

of the query, and the sets of information in order to determine the match symaciic structure 

[nTwork^v^^ 

the work by Flank and Fagan as referenced hereinabove, or even a full set of semantic relationships between the 
words as descnbed in the applicants cc-pending European Application Number. 99307422.8 £ ^n 20S^temo2 
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1999. — " _ . . 
[0014] In order to obtain the syntactic information, the parser used can be of any form. For example/ihe dependency 
parsers disclosed in GB-A-2269923, EP-A-0737928, a paperbyT Jarvinen and P. Tapanainen entitied "A Dependency 
Parser. for English" (Technical Report No. TR-1 , Department of General Linguistics, University of Helsinki, March 1 997), 
and a paper by P Tapanainen and T Jarvinen entitled "A Non-Projective Dependency Parser" (Proceedings of the 5th 
Conference on Applied Natural Language Processing, Washington DC, April 1 997, Association for Computational Lin- 
guistics). A dependency parser parses the natural language to generate meaning data which comprises meaning 
representations for. the words and links between them. The links indicate which meaning representation modifies the 
meaning of other meaning representations and the links and type of links are determined with regard to the grammar 
of the natural language. 

[001 5] An embodiment of the present invention uses the output of a finite state parser implementing a dependency 
parser technique as described in co-pending application entitled: "Apparatus and Method for Generating Processor 
Usuable Data from Natural Language Input Data" filed herewith claiming priority, from UK Patent Application No 
9904663.3 filed 1 March 1 999 by the present applicants. 

[001 6] The searching technique is applicable to the retrieval of information of many different types. For example, the 
natural language query can be used to retrieve document data. In this case, either the natural language query, can be 
compared directly, with the contents of the document, or it can be compared with an abstract of the document in order 
to perform the matching operation. The searching technique is also applicable to retrieval of non-text data. Such data 
requires a natural language caption in the form of meta data. For example, in order to retrieve images from an image 
database, where images are given captions which describe the content of the images, a natural language query, can 
be used in order to search the database to obtain a best match or matches to data in the database. 
[0017] The context data of the present invention comprises one or more unmatched units each of which has a pre- 
defined linguistic relationship to one of the matched units. In one embodiment this relationship comprises the modifi- 
cation relationship between the units. This information is obtained from a dependency parser. The generation of the 
context data in this embodiment is achieved in accordance with one or more rules which define contextually important 
modification relationships between matched and unmatched units. Thus the rules define the sort of context information 
which is to be output. 

[0018] More generally, in an embodiment the context data of the present invention is generated using one or more 
rules which contain syntactic and semantic constraints for the formation of the context data. 

[00 1 9] In an embodiment of the present invention, the generated context data is not just output but is used to structure 
the results of the search. The search result is thus the sets of information, which comprise the best matches to the 
input query, ordered in accordance with the context data. This ordering can take the form of a hierarchical arrangement 
of indexes wherein the indexes are layered in accordance with the syntactic relationships. The indexes comprise the 
matched and unmatched words of the context data. This embodiment enables a user to more easily grasp the slgnif- 
icance and relationships between the matches obtained from the search. 

[0020] The present invention also provides an enhanced data retrieval system since the desired data obtained as 
best matches to the input query is output together with this associated context information to enable a user to identify 
why the search has found that particular piece of data. 

[0021] The present invention can be implemented by software operating on a multi-purpose computer. The present 
invention is thus embodied by a computer program provided on a storage media such as a floppy disk, optical disk, . 
magnetic tape, or. programmable memory device. Further, since the computer program can be transmitted over a 
network such as the internet, the present invention can be embodied as a signal carrying the computer code. 
[0022] Embodiments of the present invention will now be described with reference to the accompanying drawings, 
in which: 

Figure 1. is a functional diagram of an embodiment of the present invention; 

Figure 2 is a schematic diagram of an embodiment of the present invention; 

Figure 3 is a flow diagram illustrating the operation of an embodiment of the present invention; 

Figure 4 illustrates the syntactic information used in the generation of the context data; 

Figure 5 is a flow diagram illustrating the use of the context data for the ordering of the results of a search in 

accordance with an embodiment of the present invention; and 

Figure 6 is a functional diagram of another, embodiment of the present invention. 

[0023] A first embodiment of the present invention will now be described with reference to Figures 1. to 5. 
[0024] Figure 1 is a diagram illustrating the functional units of an embodiment of the present invention. An interface 
lis provided for a user, to input data and to receive output data including context data. This interface includes a device . 
la for allowing the user, to enter, a query. The interface 1 also includes an output device 1 b for outputting the search 
data and the context data enabling a user to more readily, understand the relationship between the query, and the 
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retrieved data and the relationships between the retrieved data -- "^ 

J?* A f areer - 2 iS ** «?**»9 «• input queryfrom the query, input device Ja to geriereifsemantic and 
syntacbc informal™. The parser. 2 also parses information from a database 3 which is to be SSS ^ ar J r o 

eng,ne 4 .n th,s embodiment performs matching using bom semantic and syntactic informal from tS pa^e^^^ 
useotoesemanhcandsyntacacinfc^afionprovidesamorea^^^ the parser 2. The 

E !L , generating engine 5 receives data from the matching engine 4 and also receives linguistic relation- 
sh.p data from a storage device 6. A context generating engine 5 generates context data for toe Z^Th ^ . 
toT^T "? *! k" 9 i iStiC re ' ati0nSnip data - A ^"text gathering engine 7 r^y^^ e Tda^d u^ s 

toat ,t .s ordered .n accordance with the context data. The best match data, ordered in accorded* Z S£ 
data. ,s then passed to the data output device 1b for presentation to the user *" """^ 

[0027] F.gure 2 illustrates schematically an embodiment of the present invention comprising a mulfi-purpose com- 

by the computer bus 14. A display device 10 is provided for outputBng the search results and the coS data A 
processors ,s provided and tois implements sothvaretoperfom,^^ 

data generafing and gathering engine lib and the parser 11c illustrates as functions in Figure 1 A 
dev.ce (ROM) 1 2 is provided and comprises the Bios of the computer A workino Z™vw^LL • ^ V memory 

program code for causmg the processor 11 to implement the parser lie, the matching program code for caTsinaZ 

for use by the matchmg program to implement the matching engine lla. and linguistic relationship date for use bv toe 
™™ d * a9 ? nerafi ^ 
Kato'e^^^ 

[0029] A communication interface 18 is provided for interfacing the computer to a network such as a local area 
networkorthe^ntemet. Thus although in this embedment toe database 16 is^hown as befcg^^^^ 
database can be remote and accessible over the network. computer, the 

Sgure a™ 9 OPerafon ° f m& emb ° diment ° f me present inventi °n now be described with reference to 

[0031 J In step SI the user inputs a natural language query. This input query is then parsed in step S2 In step S3 a 
setore f erencedata,ntoedatabasetobe searched Selected and parsed. The parser^ 
?h! 1 T- Ca 7" 9 3 parsing operation. Rrtte stote parsers in general are wlkn^ 

<° SralU^nr^ 

un.fe. A hngustrc un,t can comprise any lexical unit such as a word or multi-words such as "toe white3e" me 
NunSfK^ ^^"^ 
« [0033J In step S6 it is determined whether there are any words which match as a result of the matching step If not 
ftoere tr " Se j^f "J* 00 ntatched w °*ds between the query in the set of reference date Ufe then determined 
f there are more sets of reference data to be matched. If. so the process returns to step S3 otherwisTthe woceS 
terminates in step S8 with the output of any context data stored in the memory. P 
[0034] The data generated as a result of the matching operation and using the finite state parser is date indicating 

iS7£rs?*ZS r TS2 spe ^ h ' l phrase brackefin9 structure - and tne dependenc * 

1 h ^ I P ma,Ched word 1 me set of matched "»* T is ••toctod. It is then determined in step S10 

whether mere are anyunmatched words in the set of reference data.lf not, the process pro,^ ,^57 because 

th^foT ?r„ B °: M be 9enerated ,W 016 set of rcferencedata. Thus, to^n^ery mShS 
^ T : ^ Unma,Cned indicatin 9 tha se » ° reference date conS 

word L The paths are defined .n path roles. The path roles define the lexical part of speech for the matcheTSI 
vahdpathdescnpbonfromthe matched word tothe unmatched wordand the phrasal category or .eSaTf^ 
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for the unmatched word. If it is determined that the matched word t and the unmatched wordy ar%#ot linked in ac- 
cordance with the path rules, 'it is determined in step SI 7. whether there are any. unmatched words left unprocessed. 
If there are in step S1 3 the next unmatched word u is selected and the process returns to step S12. If not, in step S18 
it is determined whether there are any matched words which are unprocessed. If not. the process returns to step S7 
since the algorithm has processed all matched and unmatched words for. the set of reference data. If there are still 
matched words to process in step S19 the next matched word t is selected and the process returns to step S1 0. 
[0036J If in step S12 it is determined that the unmatched word u is at the end of a path from a matched word t as 
defined in the path rules, in step S 1 4 .it is determined whether the unmatched word u is present in a valid phrase defined 
in the valid phrase rule. If there is no valid phrase, in step S1 3 the next unmatched word u is selected and the process 
returns to step S 1 2. If a valid phrase is identified the smallest valid phrase containing the word u is determined in step 
S15 and in step S16 the phrase is added to the memory referenced to the matched word t The memory thus stores 
the context data as unmatched words or phrases reference or. linked to the respective matched words. 
[0037] The valid phrase can comprise a part of speech for a word, or a phrasal category for a group of words. In 
step S1 7 it is then determined whether there are any unmatched words still left unprocessed and rf so the process 
returns to step S 1 3 to select the next unmatched word. If not in step S 1 8 it is determined whether there are any matched 
words left unprocessed. If not the process returns to in step S7 since the unmatched and matched words have been 
processed for the set of reference data. If there are still matched words to be processed, in step S1 9 the next matched 
words t is selected and the process returns to step S10. 

[0038] Once a query has been input and parsed, the parsing, matching and context generation steps will be repeated 
for each set of reference data. 

[0039] The operation of steps S9 to S19 will now be described in more detail with reference to an example. 
[0040] The output of the matching process using the finite state parsing technique is a phrase represented as a 
sequence of words with their parts of speech, a phrase bracketing structure, and the dependency, relationships. Here- 
inafter, the part of speech (pos) is given by following each word with "_POS\ The phrase bracketing for a phrase type 
PT. is given as "[...]PT. In addition words in the sets of reference data which match words in the query, are marked in 
BOLD. 

[0041] For the query: 

"camera with a lens" 
and the reference data: 
"black SLR camera with a zoom lens on a white surface" 
the data output from the matching engine is: 

[[black.adj SLR.noun camera_noun]NG, 
[with_prep a_det zoom_noun lens_noun]PP, 
[on_prep a_det white_adj surface_noun]PP]NP 

mod[camera]=black 

mod[camera]=SLR 

pmod[camera]=with 

pmod[camera]=on 

mod[with]=lens 

mod[lens]=zoom 

mod[onJ=surface 

mod[surface]=white 

[0042] In the notation given hereinabove, the parts of speech are: 

adj - adjective 

noun - noun 

prep - preposition 

det - determiner 

[0043] The phrase types are: 

NG - noun group 

PP.- prepositional phrase 

NP - noun phrase 



[0044] The dependency relationships are given as indexed variables as generated by the finite state parser, described 
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[Q047J The algonthm uses path rules as mentioned hereinabove. Each path rule has the form <r„r p ,r c >^here 

r, is a lexical part of speech for the matched word, 

r p is a path description as described hereinabove^ and 

r e is a phrasal category or a lexical part of speech for the unmatched word. 

has_pos(t,c) 
on_path(t,u,p) 

fS ^VS^TT 1 '^ unma,ched ^ a "dPi^Pathdescription. 

element then on_path^^ a * ■ P ""sis* of a single 

is q and the rest of the list Is r, then on pa«Z , ax fe IT^fffi ^ " an,eS ' ° f wWch 11,8 firSt 

W such mat w is not marked as tn^S^^^^f^^^ « J*** * arnember of q 
^-^xedv^nha^ 

Valid-Phrase (C,p,u) 
The Main Algorithm 

ESS ^t% m hTth ,9 °?7 lm P ,emented b * ste ? s S7 10 ■ S 1 7. can be written in pseudo code as follows* 
[0056J Let S be the set of contexts, initially, empty (output) 

[0057] Let P. be the set of path rules (input). 

!2 !- etTbethesetof ^ e ^^ 

[0059] Let U be the set of available words, initialised to all unmatched words (input). 



so 
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while T is .not empty 
{ 

select a word t from T 
for each word u in U 
( 



20 if there is a path rule <r t/ r p ,r c > in P such 

that 

has_pos(t,r t ) 

25 

AND on_path(t,u, r p ) 
then 

30 find the smallest phrase C such that 

valid_phrase (C,r c ,u) 

if there is such a C then 

35 

add the context <t,C> to S 
remove u from U 

40 } 

remove t from T 

} 

45 

[0060] By "smallest phrase" what is meant is that if there is a valid phrase C and valid phrase D, and C is entirely 
contained within D,. then the C is used. 

[0061] The operation of. the algorithm wilt now be illustrated with reference to the example described hereinabove 
so and illustrated in Figure 4. 

[0062] The initial set T={camera,lens} 

[0063J The initial set U={black,SLR,zoom f white,surface, with.on.a}. 
[0064] The path rules to be used are: — 

55 1 . <* f mod, # >. (this finds modifiers) 

2. <*,pmod:mod,PP>. (this finds prepositional phrases (PPs)) 

[0065] With the first matched word t="camera\ and in the first unmatched word u="black" the first rule applies be- 
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' has_pos(camera,*)=TRUE 
on_path(carnera,black F mod)=TRUE 



[0067] With the second unmatched word u="^l r- n ,\* 1 

context data <carnera, [S L R] noun> "„ £ ^ ? "* ~ — " 38 *™ - "« the 



has_pos(camera,*)=TRUE 
on_path(camera,surface f pmod:mod)=TRUE 



SS^^ « * *»* *"« - - context data <camera,on a white 

K S! ° f <h ! unrna u ,ched WOfds fof ™'<*e° word t="camera" have thus been processed 



has_pos(lens,*)=TRUE 
on_path(lens,2oom,mod)=TRUE 



[0073] The result of the algorithm is thus a set S of context data Each entrv in th* ^ ~ 
and an unmatched word or phrase linguistica.iy related o Z IlSS^Sd T^ZT*" 
enable them to identify where the input query matches *»^J*£-Jfir . J? 5 M " ° UtpUt to a user to 

hereinabove can be used to achieve this by gathering the contexts 38 d6SCnbed 

555 

a context phrase. In the example given above the context ^^"'V^^**.. 

<camera,[black]adj> 
<camera,[SLRJnoun> 
40 <camera,[on a white surface]PP> 

<lens,[zoom]noun> 

S5 d l 8 L Ame ^ off0 ™^^ 
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[0082] The data sets which match are listed below together with their context data. In the context data Q means that 
there is no context data. Paths between the matched and unmatched words are also given in the context data below 
and are given in [„. J. r 



camera with a lens 
{> 



Large camera with a lens 

<camera [mod], large> 



camera with a lens on a table 

20 

<camera lpmod:mod], [on a table ]PP> 

25 Large camera with a 200m lens 

<camera [mod J, large> 
<lens [mod],zoom> 

30 

camera on a table with a long zoom lens 



<camera [pmodrmod], [on a table ]PP> 
<lens [mod],zoom> 
<lens [mod],long> 



[0083] In step S21. of Figure 5 for each matched (governor) word the context data is concatenated so that there is 
45 a single context datafor a particular, matched word and a particular path. In the example given above, the concatenation 
of the last example results in: 

camera on a table with a long zoom lens 
<camera [pmod:mod],[on a table]PP> 
<lens [mod], long & zoom> 
so [0084] In the process of this example the following path list is used* 
D 

[mod], [pmod:mod] 

[0085] 0 indicates an empty, path and is used to identify, a matched (governor) word. This path is at the first level. 
The paths [mod] and [pmodrmod] are both at the second level. 
55 [0086] Using the path list and knowledge of the head of the input query, the head word is selected in step S22 of 
Figure 5. In step S23 is then determined whether there are any context words. If there are not, in step S24 the process 
then determines whether there are any further matched words which have not been processed. If not, in step S30 the 
process terminates by. storing any. indexes and sub-indexes which have been determined. If there are further matched 
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words to be processed in step S25 the next matched word in the modification sequence is setectedlaa suWndex 
and the process returns to step S23. . - .. • - - ^ suwnaex 

[00871 In the present example, in step S23 it is determined that there are context words Thus in steo s?« th» - 

.SromexT^O ZT T I!' 7 d3,a 86,8 ^ 9fDUped aCCOrdi "9 to «™*» context Si^SI 
the context data for. the example given above is iHustrated below: 09 

Camera 

large 

large camera with a lens 
large camera with a zoom lens 
ton a table ]PP 

camera with a lens on a table 

camera with a long zoom lens on a table 

() 

camera with a lens 

[0088] In the above, the matched word (the head word) is shown in bold. 0 means empty context- "camera with » 
tens exactly matched the query and there is no context data in relation to camera 3 

ZsnsteS^^^ 

Sasl Inthel!^^ P . I" and StepS27 fe repeated to generate furthersuWndexed groupsof 

data sets. In ttw present example ,n step S28 it is determined that there are no more path levels and thus m steo S25 

£ Z f fl ? 1 Sel6C,ed 33 3 ****** ^ 06X1 ^ l *^^'««"xS a r m ev^wSSs 
.s used as a sub-mdex for groups of more than one data sets. The process then returns to step S22 S 

second path level is selected, a step S27 the data sets are nrour^H armrHinn t~ »k exiTorine 
indexed accordingly. The resu.t of thfc is HluSted oetow: " ^ " 9 ** M WOrds and 

Camera 

large 

lens 

zoom 

large camera with a zoom lens 

() 

large camera with a lens 
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[on a table JPP 
lens 

long & zoom 

camera with a long zoom lens on 
a table 

() 

camera with a lens on a table 

() 

camera with a lens 

[0090J The result in step S30 is the storage of the hierarchial indexes and suWndexes to which data sets belong. 
For example, the data set "large camera with a zoom lens" is indexed by camera:large:lens:zoom. A camera with a 
lens on a table is indexed by. camerarfon a table]PP: lens:(). 

[0091 J This ordering of the data using the context data enables the data to be output to a user in a format which 
enables the user to more easily understand the context of the match. 

[0092] A number of levels of context information depend upon the path levels used and the number of matched 
words. The number of contexts in each level will depend upon the context of the database being searched. For example, 
in the first level in the example given above there are, only two contexts: large and [on a tableJPP. If there were further 
data sets e.g. red camera with a lens on a table, small camera with a lens on a table etc, the number of contexts in 
the first level would be greater. 

[0093] A second embodiment to the present invention will now be described with reference to Figure 6. 
[0094J Figure 6 is a functional diagram of a second embodiment which has similar components to the functional 
diagram of the first embodiment illustrated in Figure 1 . The second embodiment differs from the first embodiment only 
in that the parser 2 of the first embodiment which receives the input query and the data sets from the database 3, is 
replaced with a parser 20 which parses the output of the matching engine 4. In this embodiment the matching engine 
will perform key word matching. The syntactic information required in order to generate the context data is obtained 
by the parsing operation of the parser 20 subsequent to the matching process. This em bodiment benefits from a simpler 
matching process but suffers from lack of accuracy in the matching process because of the lack of syntactic information. 
[0095J Although the present invention there has been described hereinabove with reference to specific embodiments, 
the present invention is not limited to these specific embodiments and modifications are possible within the scope of 
the invention as defined in the appendant claims. 

[0096] In particular, the present invention is not limited to any. particular, type of matching process. The matching 
process needs only to identify words in the query which match words in the sets of data in the database. 
[0097] In order to obtain the necessary syntactic information to enable the formation of context data, a level of parsing 
is required. Any form of parser which can provide some form of the syntactic information can be used in the implemen- 
tation of the present invention. For example, the pure dependency parser can be used as disclosed in the paper entitled 
"Parsing English with a Link Grammar by D Sleator and D Temperley (Carnegie Mellon University School of Computer 
Science, Technical Report No. CMEU CS 91 1 96, October 1991). In this system there is no phrase bracketing provided 
but parts of the algorithm that extract phrases could instead extract a sequence of words defined by having certain 
dependency, links with matched terms. Parsers are disclosed in GB-A-2269923, EP-A-0737928, the paper by T Jarvinen 
and P Tapanainen, and the paper by P Tapanainen and T Jarvinen for example. Also, simpler parsing techniques could 
be used such as disclosed in the paper, by S Flank. 

[0098] The present invention is applicable to any form of searching technique and can be used with a wide range of 
search engines such as a web search engine and a database search engine. The output of such a search engine 
incorporating the present invention provides far more information to the user, and allows the user to see the context of 
the results of the search. 

[0099] Although the present invention has been described hereinabove as residing in a programmed multipurpose 
computer, the present invention can of course be implemented using specifically designed hardware such as a logic 
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circuit. 
Claims 



1. Search apparatuses 

™^ 

uTZelaS fW S6arChin9 ^ ta *'-»"««*-„*.*-I.M W «d h 
generating means for. where there are unmatched units in the query and/or the data, generating context data 
in the form of one or more unmatched units of the query and/or the data 

predefined linguistic relationship to one of me or each^chedunit^n? ^ ^ * 

formmg means for forming said output data as any said matched unhs and any respective said context data 

' ^^^^^^^^^^^ 

sets erf data bemg identified by :a final said sublayer in the hierarchical structure. "inner sublayers. sa,d 

9. A computer, implemented data processing method for processing data to enhance the results of a search for rf a h, 
in the form of units of a natural language, the method comprising: t3 

searching for and identifying any matches between the units of the input query and units of the data- 

forming said output data as any said matched units and any. respective said context data. 

10. A method according to claim 9. wherein the or. each unmatched unit of the context data is oenerated havino a 
predefined modification relationship to the respective matched units. generated havmg a 

11. Amethod according to claim 9 or daim 10. wherein the context datais generated in accordance witt, one or more 
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rules defining cpntextually important modification relationships between matched and.unmatchednjnits.- 

12. A method according to claim 9 or claim 10, wherein the context data is generated in accordance with one or. more 
rules containing syntactic and semantic constraints for the formation of the context data. 

13. A method according to any one of claims 9 to 12, including parsing the input query and/or the data or. the output 
of. the matching step to determine linguistic relationships between the units. 

14. A method according to any. one of claims 9 to 13, wherein the output data is formed as any said matched units 
associated with respective said unmatched units having said predefined linguistic relationships to respective 
matched units. 

15. A method according to any one of claims 9 to 14, wherein said output data is formed as a layered hierarchical 
structure identifying sets of data by their, context data. 

1 6. A method according to claim 1 5, wherein said output data is formed from a said matched word comprising a head 
word of the input query, said context data for. said head word forming one or more sublayers, any. further matched 
words forming further, sublayers of said sublayers, the order of selection of said further matched words being 
dependent on their, modification relationship within the input query, said context data for said further, matched words 
forming yet further sublayers, said sets of data being identified by. a final said sublayer, in the hierarchical structure. 

17. Data retrieval apparatus for retrieving desired information units of a natural language from a plurality, of available 
information units, the apparatus comprising: 

input means for. inputting a query, in units of the natural language; 

matching means for searching for. and identifying any matches between the units of the input query and the 
units of the available information units to identify, the best matches between the input query, and the plurality 
of available information units; 

generating means for receiving the best matches and for where there are unmatched units in the input query 
and/or the information units, generating context data in the form of one or more unmatched units each having 
a predefined linguistic relationship to one of the or each matched unit; and 

output means for. outputting desired information units as the best matches with respective context data. 

18. Data retrieval apparatus according to claim 17, wherein said output means is adapted to output the desired infor- 
mation units ordered by said context data. 

19. A computer implemented data retrieval method for retrieving desired information units containing units of a natural 
language for a plurality of available information units, the method comprising: 

inputting a query in units of the natural language; 

searching for. and identifying any matches between the units of the input query and the units of the available 
information units to identify, the best matches between the input query and the plurality of available information 
units; 

for the best matches where there are unmatched units in the query and/or the information units, generating 
context data in the form of one or. more unmatched unit each having a predefined linguistic relationship to one 
of the or each matched unit; and 

outputting desired information units as the best matches with respective said context data. 

20. The method of claim 19, wherein the desired information units are output ordered by. said context data. 

21 . A carrier medium carrying processor implementable instructions for controlling a processor, to carry out the method 
of. any one of claims 9 to 1 6, 1 9 or. 20. 

22. A signal carrying processor implementable instructions for controlling a processor, to carry out the method of any 
one of claims 9 to 1 6, 1 9 or 20. 
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